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DETAILED ACTION 
Response to Amendment 

1 . The amendment was received on November 28, 2005. Claims 1-24 are pending. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1,6,7,9,15 and 16 have been 
considered but are moot in view of the new ground(s) of rejection under Lelong et al. 
(US Patent 5,444,478 A). 

Specification 

3. Due to the amendment, the objection to the specification is withdrawn. 

Claim Rejections - 35 USC §112 

4. Due to the amendment, the 112 rejections of claims 1,6,7,9,15 and 16 are 
withdrawn. 

Claim Objections 

5. The following quotations of 37 CFR § 1 .75(a) is the basis of objection: 

(a) The specification must conclude with a claim particularly pointing out and distinctly claiming 
the subject matter which the applicant regards as his invention or discovery. 

6. Claim 1 0 is objected to under 37 CFR § 1 .75(a) as failing to particularly point out 
and distinctly claim the subject matter which the applicant regards as his invention or 
discovery. 

Claim 10, line 3: "original image" ought to be amended to "tangible object". 
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Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

8. Claims 1,3-10 and 12-24 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Lelong et al. (US Patent 5,444,478 A). 

Regarding claims 1 and 9, Lelong et al. discloses an image processing method 
and apparatus for correcting image distortions caused by oblique imaging in which a 
tangible object on an object plane is captured from different oblique directions to obtain 
a plurality of partially overlapping images, comprising the steps of: 

a) a correspondence detecting unit (Fig. 3, num. 200 is used in a "calibration" 
in col. 16, line 63 via the method from col. 16, line 63 to col. 17, line 13) determining a 
feature point ("seam" in col. 16, line 47 and shown in fig. 1E, label: "U") of one of the 
plurality of partially overlapping images( in an "overlap zone" in col. 16, lines 49,50) 
corresponding to a common location of the tangible object (The building of figures 7 A 
and 7B), shared by the plurality of partially overlapping images, and 
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b) determining a matched point of one of the other partially overlapping 
images corresponding to the feature point (to create "a perfect juxtapo-sition" in col. 16, 
lines 66,67) so that a direction (Fig. 5B, direction or line "PM".) of the tangible object 
plane (Fig. 5B, label" lo") is calculated based on the feature point and the matched point 
(Note that the above mentioned perfect juxtaposition is interpreted as matching features 
of an image Si in fig. 7C to features of an image Sj in fig. 7C along a seam, L in fig. 7C 
to create a seamless image as shown in fig. 7D where no seam is visible and respective 
portions of the image such as the building and trees are matched to create "a 
uniform. ..image" in col. 17, lines 12,13.); 

c) a standard image setting unit (fig. 3, num. 205) selecting one ("selecting 
one" in col. 6, line 46) of the plurality of partially overlapping images (Fig. 6, num. 205) 
as a standard image (via a "reference... camera" in col. 9, line 66 that creates a "source 
image" in col. 9, line 67 which is interpreted as the claimed standard image) whose 
image distortions are to be corrected (as shown in fig. 7D relative to fig. 7C); and 

d) a distortion correcting unit (fig. 3,num. 112) generating a distortion- 
corrected image (fig. 7D) on a projection plane (or "projected in the... plane" in col. 8, 
line 1 1 ) by projecting the standard image onto the projection plane based on the 
direction of the tangible object plane such that image distortions in the standard image 
are eliminated. 



Application/Control Number: 09/940,432 Page 5 

Art Unit: 2621 

Regarding claim 3, Lelong et al. discloses the image processing method 
according to claim 1 wherein in said selecting step, one of the plurality of partially 
overlapping images is automatically ("automatically" in col. 17, line 14) selected as the 
standard based on a direction of a straight-line pattern (fig. 1E, label: "U") contained in 
each image. 

Claims 4 and 5 are rejected the same as claim 1 . Thus, argument similar to that 
presented above for claim 1 is equally applicable to claims 4 and 5. 

Claim 6 is rejected the same as claim 1 . Thus, argument similar to that 
presented above for claim 1 is equally applicable to claim 6 except for the remaining 
limitations of: 

a) selecting one of the plurality of partially overlapping images as a standard 
image (Fig. 6, num. 205) that contains a smallest amount of image distortions (via a 
"feedback" in col. 16, line 64 to create "a target image without any faults" in col. 16, lines 
67,68. Thus, if a target image is created without any faults then the images that were 
used to create the target image also have no faults.) among the plurality of partially 
overlapping images; and 

b) combining the other partially overlapping images, which are projected (as 
shown in fig. 1 A via a plurality of lines that radiate from point "P".) onto an image 
surface (Fig. 1 A, label: "l 0 ") of the standard image with respect to each of the other 
partially overlapping images, so that a composite image (fig. 7D) is generated on the 
image surface so as to correct image distortions in the standard image (relative to the 
image of fig. 7C). 
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Claim 7 is rejected the same as claims 1 and 9. Thus, argument similar to that 
presented above for claims 1 and 9 is equally applicable to claim 7 except for the 
limitation disclosed in Lelong et al. of: 

a) an image composition unit ("Devices capable of realiz-ing these 
operations" in col. 17, lines 5,6 such as "perfect juxtapo-sition" in col. 16, lines 66,67.) 
combining (via a "joint" in col. 9, line 42) the other partially overlapping images, which 
are projected (as shown in fig. 1 A via a plurality of lines that radiate from point "P".) onto 
an image surface (Fig. 1A, label: "l 0 ") of the standard image with respect to each of the 
other partially overlapping images, so that a composite image (fig. 7D) is generated on 
the image surface so as to correct image distortions in the standard image (relative to 
the image of fig. 7C). 

Regarding claim 8, Lelong et al. discloses the image processing apparatus 
according to claim 7, 

a) wherein said standard image setting unit (fig. 3,num. 205) is configured 
such that a user (via fig. 3,num. 2) is required to select the standard image when taking 
the original image from one of the oblique directions (Fig. 7A shows an image of a 
scene at one angle and fig. 7B shows another image of the same scene at another 
angle so that when both images are combined as shown in fig. 7C distortions are shown 
because the images of the same scene were taken at different angles.), and 

b) wherein said image processing apparatus further comprises: 

b1 ) a notification unit (Fig. 21 , num. 2) which notifies the user that the 
standard image is currently taken (via fig. 3,num. 205). 
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Regarding claim 10, Lelong et al. discloses the image processing apparatus 
according to claim 9, further comprising: 

a) a plurality of imaging units (Fig. 1G, label "P") which respectively input the 
plurality of partially overlapping images that are generated by taking the original image 
from the oblique directions. 

Claims 12-14 are rejected the same as claims 3-5, respectively. Thus, argument 
similar to that presented above for claims 3-5 is equally applicable to claims 12-14, 
respectively. 

Claim 15 is rejected the same as claims 1 and 9. Thus, argument similar to that 
presented above for claims 1 and 9 is equally applicable to claim 15 except for the 
additional limitation of a computer-readable storage medium as disclosed in Lelong et 
al. in fig. 3, num, 210. 

Claim 16 is rejected the same as claims 7 and 15. Thus, argument similar to that 
presented above for claims 7 and 15 is equally applicable to claim 16. 

Regarding claim 17, Lelong et al. discloses the image processing method of 
claim 1, wherein said standard image is projected with a perspective projection matrix 
operation (or " 'perspective transform 1 " in col. 14, line 57). 

Claims 18-22 are rejected the same as claim 17. Thus, argument similar to that 
presented above for claim 17 is equally applicable to claims 18-22. 
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Regarding claim 23, Lelong discloses the image processing method of claim 17, 
wherein said perspective projection matrix is calculated based on coordinates (or 
"coordinates" in col. 14, line 61) of at least four combinations of feature points of the 
standard image and matched points corresponding thereto (via a "4 X 4 matrix" in col. 
14, line 62). 

Regarding claim 24 see "least-squares method" in col. 15, line 17. 
Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

10. Claims 2 and 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Lelong et al. (US Patent 5,444,478 A) in view of Lee (US Patent 6,507,366 B1). 

Regarding claim 2, Lelong et al. teaches the image processing method according 
to claim 1 wherein in said selecting step, one of the plurality of partially overlapping 
images is automatically (or "automatically" in col. 17, line 14) selected (via fig. 3,num. 2 
which can be an automatic process that selects the standard image via fig. 3, num. 205.) 
as the standard image. 
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Lelong et al. does not teach the remaining limitation of selecting the standard 
image based on a ratio of an area of an object region to an entire area of each image, 
but does teach an "automatic function" in col. 4, line 61 for "monitor[ing]" in col. 4, line 
40. Thus, Leiong et al. suggests that an automatic process can be used for monitoring 
automatically, but does not provide enough details on the automatic aspect of 
monitoring. Thus, one of ordinary skill in the art will be motivated to find an automatic 
process of monitoring so that a person is freed from monitoring a scene and so that the 
person can perform other duties. 

Lee teaches "monitoring" in col. 1, line 12 and "automatically tracking" in the 
abstract as taught in Lelong et al. and the remaining limitation of claim 2: 

a) selecting (via fig. 3A,num. 360) based on a ratio of an area of an object 
region (or "region ratio" in col. 9, line 1) to an entire area (or "effective region" in col. 9, 
line 3) of each image. 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to modify Lelong et al.'s teaching of selecting the standard image and 
automatic monitoring with Lee's teaching of selecting or automatic tracking via fig. 
3A,num. 360 so that Lelong et al's selecting the standard image, either one of lj shown 
twice as shown in fig. 1E of Lelong et al. can be automatically tracked or monitored 
freeing a person from monitoring to perform other duties. 

Claim 1 1 is rejected the same as claim 2. Thus, argument similar to that 
presented above for claim 2 is equally applicable to claim 1 1 . 
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Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Okisu et al. (US Patents 6,806,903 B1, 6,535,250 B1 and 6,449,004 B1) is 
pertinent as teaching oblique imaging. 

Uchiyama et al. (US Patent 5,727,093 A) is pertinent as teaching a method of 
determining a reference image, fig. 1,num. 2, and a geometric transformation to 
compensate of geometric distortion as shown in fig. 16. This reference is applicable to 
claim 1. 

Ejiri et al. (US Patent 6,104,840 A) is pertinent as teaching a standard image in 
fig. 7, S32 and a composite image as shown in fig. 1 . This reference is applicable to 
claim 1. 

12. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action by changing "original image" to "tangible object" for all independent 
claims. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

1 3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dennis Rosario whose telephone number is (571) 272- 
7397. The examiner can normally be reached on 6-3. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Mancuso can be reached on (571) 272-7695. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). // 



Dennis Rosario 
Unit 2621 
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